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ABSTRACT 

This paper describes an experiment conducted in order 
to improve the reliability and validity of the Achievement via 
Conformance (AC) scale of the California Psychological Inventory 
(CPI) . The primary goal of AC is to identify those factors of 
interest and motivation which facilitate achievement in any setting 
where conformance is positive behavior. The purposes of the study 
were: (1) to examine the correlation of the AC scale with grade point 
average for 40 randomly selected college male freshmen; and (2) to 
attempt to improve the reliability and validity of the AC scale by 
dropping various test items after each computer analysis. It was 
found that elimination of "bad" test items of the scale enhanced both 
its validity and reliability. Relationships between AC and various 
intellectual variables were found to be in need of much additional 
empirical investigation. (SJL) 
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IMPROVING RELIABILITY AND VALIDITY OF "ACHIEVEMENT VIA CONFORMANCE^;. THROUGH 

COMPUTER APPLICATIONS / 

I 

Dr. Donald E. Riggs 
Director of Libraries and Media Services 
B1uefie1d State College, Concord College and Greenbrier Community College 

Introduction . This writer has always been intrigued with and interested in 
the various psychological tests and their relationships with measures of intelli- 
gence. Having had some experience with psychological tests (e.g., Ohio State 
Psychological Examination) and an enthusiasm to learn more about various aspects 
of psychological testing, this project provided an opportunity to experiment with 
the improvement of reliability and validity of the Achievement via Conformance 
(Ac) scale of the California Psychological Inventory (CPI). 

The primary goal of Ac is to identify those factors of interest a"?d motivation 
which facilitate achievement in any setting where conformance is a positive behav- 
ior, ^'gh scorers tend to be seen as: capable, co-operative, efficient, organized, 
responsible, stable, and sincere; as being persistent and industrious; and as val- 
uing intellectual activity and intellectual achievement. Low scorers tend to be 
seen as: coarse, stubborn, aloof, awkward, insecure, and opinionated; as easily 
disorganized under stress or pressures to conform; and as pessimistic about their 
occupat i onal futures . 

It is interesting to note ths apparent contradictions in the results of 
various studies; concerning the usefulness of Gough's (4) California Psychological 
Inventory (CPI) as a predictor of academic achievement. In particular, the Ac 
(Achievement via Conformance), Ai (Achievement via Independence), and le (Intel- 
lectual Efficiency) scales have been investigated in relation to grade point aver- 
age (GPA) and several measures of intellectual ability. The outcomes of such 
studies have been generally inconsistent and equivocal. For example, Bendig (1) 
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obtained correlations running from .35 to .68 for men arid from .42 to .46 for 
women in his study of Ac as a predictor for GPA in psychology courses. Watson (9) 
also experimented with the three intellectual related scales of the CPI. 

Purpose of the Study . The purposes of the study were: 1 . ) To examine the 
correlation of the Ac scale of the CPI with GPA for forty randomly selected college 
male freshmen who had completed at least the equivalent of one full-time semester 
(12 credit hours) at Bluefield State College; 2.) To attempt to improve the reli- 
ability and validity of the Ac scale by dropping various test items after each com- 
puter run; 3.) To obtain some personal satisfaction and enjoyment from working with 
a psychological testing instrument which would result in a rewarding learning ex-, 
perience. / 

Procedure . Forty male freshmen were selected for the experiment with the Ac 
scale (32 test items) by taking the first forty male students in order of social 
security numbers (i.e., in an attempt to get a random sample). The GPA's of these 
students were used as the criterion scores and the correct responses of the Ac scale 
were used as the predictor scores. These scores were then programmed via BMD02D 
Correlation with Transgeneration Package. The package enabled one to obtain a com- 
puter printout of iums, means, standard deviations, correlation matrices, and a 
plotting graph of variables. Computations were performed utilizing: 1.) The 



validity graph (see Table II in Appendix); 4.) A reliability graph (see Table III 
in Appendix); 5.) A difficulty factor for each item (see Table IV in Appendix). 



1. Table I (Appendix) displays the computer printout and computations of 
the first computer run. Results of the first computer run: KR 20 = .7413, 
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2. Table II (Appendix) exhibits the plotting of the validity with the 
centroid T/y-f^Z and (f;)^x-rJz) . The results on the graph reveal that items 
number 14, 16, 17, 19, 20, 22, 25, 27 and 30 should be dropped in order to 
improve validity in the second computer run. Results of the second computer 
run: KR 20 = .7687, fxy = .6612. 

3. Table III (Appendix) exhibits the plotting of the reliability. The 
results on the graph reveal that items number 8, 10, 12, 13, 15, 17, 19, 20 and 
27 should be dropped in order to improve reliability in the third computer vun. 
Results of the third computer run: KR 20 = .7679, fjt^ = .6748. 

4. A fourth computer run was made with the intent in mind to eliminate 
identical items (17, 19, 20, 27) which would simultaneously enhance both validity 
and reliability as compared with the first computer run. Results of the fourth 
computer rui;: KR 20 = .7510, riy = .6646. 

Discussion . Computer run two is best for improving validity; computer run 
three gives the best results for reliability. As denoted in the findings, the 
Ac scale's reliability and validity can both be improved simultaneously (computer 
run four). This particular method of improving both of thei;e aspects at the same 
time is of signal importance in test construction and refinement. 

Relative to the difficulty factor of each test item (Table IV - Appendix), 
one should note that the extreme differences in difficulty of some items would 
most likely hinder one from applying the KR 21 Formula to the results of this 
particular Ac scale. Essentially, the KR 21 Formula would most likely yield 
lower approximations if applied to this data than would KR 20. 

For purely curiosity's sake, a criterion score (GPA) and a predictor score 
(correct responses of a 50 item test) of the Intellectual Efficiency (le) scale of 
the CPI were obtained in a separate computer run. The KR 20 was .7189 and X%y 
was .6^00. Further research is needed to be done with two-scale analyses (e.g.. 
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Ac and le) of the CPI. Finding the intercorrelation of the scales would provide 
an interesting challenge. 

Conclusion and Rocommendations . 0;ie thing is evident from this study: By 
eliminating "bad" test items of the Ac scale both validity and reliability may be 
enhanced. Gough (5) has revealed that the Ac scale has positive correlation with 
academic achievement. However, based on a close scrutiny of the literature, this 
writer could not find any trace of where anyone has attempted to refine the CPI 
by eradicating some of the "bad" items of the various scales. Undoubtedly, some 
of the same items will continue to appear to "fall short" during the various admin- 
istrations of the CPI. Why has someone not restructured the CPI? If the CPI in 
its entirety, or in parts by scales, is to contain the utmost reliability and 
validity relative to test items, then constant refinement needs to be done. 

From this project and investigation of the literature, it can only be con- 
cluded that the relationships between Ac and various intellectual variables re- 
quire much additional empirical investigation before a more concrete understanding 
may prevail. Perhaps enough interest has been stimulated by this project to en- 
courage someone to independently explore more thorough means of improving the 
efficiency of the Ac and other scales as positive indicators. 
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TABLE IV 

Items, Number of Correct Responses, 
and Difficulty Factor in KR20 Calculation 
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